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Abstract 

The mechanism of preferential attachment underpins 
most recent social network formation models. Yet few 
authors attempt to check or quantify assumptions on 
this mechanism. We call generalized preferential at- 
tachment any kind of preference to interact with other 
agents with respect to any node property. We then 
introduce tools for measuring empirically and charac- 
terizing comprehensively such phenomena, and apply 
these tools to a socio-semantic network of scientific col- 
laborations, investigating in particular homophilic be- 
havior. This opens the way to a whole class of realistic 
and credible social network morphogenesis models. 



random graphs as regards several statistical pa- 
rameters; and foremost with respect to node con- 
nectivity distribution, or degree distribution. In- 
deed, in random graphs a la Erdos-Renyi 12 links 
between agents are present with a constant prob- 
ability p and degree distributions follow a Pois- 
son law whereas empirical social networks exhibit 
power-law, or scale- free, degree distributions £Q. 
This phenomenon suggested that link formation 
does not occur randomly but instead depends on 
node and network properties — that is, agents do 
not interact at random but instead according to 
heterogeneous preferences for other nodes. 
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Introduction 

A recent challenge in structural research in social 
science consists in modeling social network forma- 
tion. Social networks are usually interaction net- 
works — nodes are agents and links between nodes 
represent interactions between agents — and in 
this respect, modeling them involves disciplines 
linked both to graph theory (computer science and 
statistical physics), mathematical sociology and 
economics P El EE1 Most of the interest in this 
topic stems from the empirical observation that 
real social networks strongly differ from uniform 
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Hence, early social network models endeavored 
to describe non-uniform interaction and growth 
mechanisms yielding the famous "scale-free" de- 
gree distribution [2] . Subsequently, much work has 
been focused on determining processes explaining 
and rebuilding more complex network structures 
consistent with those observed in the real world — 
a consistency validated through a rich set of statis- 
tical parameters measured on empirical networks, 
not limited to degree distribution but including as 
well clustering coefficient, average distance, assor- 
tativity, etc. pi71l2T)j. 

However, even when cognitively, sociologically 
or anthropologically credible, most of the hypothe- 
ses driving these models are mathematical abstrac- 
tions that do not enjoy any experimental measure- 
ment or justification. In this paper, we call pref- 
erential attachment (PA) any kind of non-uniform 
interaction behavior and introduce tools for em- 
pirically measuring PA with respect to any node 
property. We eventually apply these measures to 
an empirical case of socio-semantic network. In 
particular, we will criticize degree-related PA, and 
estimate homophily. 
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1 A brief survey of social net- 
work models 

Barabasi & Albert pioneered the use of prefer- 
ential linking in social network formation models 
to successfully rebuild a particular statistical pa- 
rameter, the scale-free degree distribution. In their 
model, new nodes arrive at a constant rate and at- 
tach to already-existing nodes with a likeliness lin- 
early proportional to their degree. This model has 
been widely spread and reused, and consequently 
made the term "preferential attachment" often 
understood as degree-related only preferential at- 
tachment. Since then, many authors introduced 
diverse modes of preferential link creation depend- 
ing on either various node properties (hidden vari- 
ables and "types" [SJ fitness 0, centrality, 
euclidian distance {Jjjjjj, common friends ^B], bi- 
partite structure [14] . etc.) or on various linking 
mechanisms (competitive trade-off and optimiza- 
tion heuristics ^3 E] > two-steps node choice [2H| , 
to cite a few). 

However and even in recent papers, hypotheses 
on PA are often arbitrary and at best supported by 
qualitative intuitions. Existing quantitative esti- 
mations of PA and consequent validations of mod- 
eling assumptions are extremely rare. In this re- 
spect, most studies are either (i) related to the 
classical degree-related PA j3J El El 122] j some- 
times extended to a selected network property, like 
common acquaintances [19] : or (ii) reducing PA to 
a single parameter: for instance using econometric 
approaches |23 or Markovian models |27j- While 
of great interest in approaching the underlying be- 
haviorial reality of social networks, these works 
may not be able to provide a sufficient empirical 
basis and support for designing trustworthy PA 
mechanisms, and accordingly for proposing credi- 
ble social network morphogenesis models. Yet in 
this view we argue that the three following points 
are key: 

1. Node degree does not make it all — and even 
the popular degree-related PA (a linear "rich- 
get-richer" heuristics) seems to be inaccurate 
for some types of real networks [H] , and possi- 
bly based on flawed behavioral fundations, as 
we will suggest below in Sec. 14.21 

2. Strict social network topology and derived 
properties may not be sufficient to account 
for complex social phenomena — as several 



above-cited models suggest, introducing "ex- 
ternal" properties (such as e.g. node types) 
may influence interaction; explaining for in- 
stance homophily-related PA ^Sj requires at 
least to qualify nodes. 

3. Single parameters cannot express the rich het- 
erogeneity of interaction behavior — for in- 
stance, when assigning a unique parameter to 
preferential interaction with close nodes, one 
misses the fact that such interaction could 
be significantly more frequent for very close 
nodes than for loosely close nodes, or be 
quadratic with respect to the distance, etc. 

To summarize, it is thus crucial to conceive PA 
in such a way that (i) it is a flexible and gen- 
eral mechanism, depending on relevant parame- 
ters based on both topological and non-topological 
properties; and (ii) it is an empirically valid func- 
tion describing the whole scope of possible inter- 
actions. 

2 Measuring preferential at- 
tachment 

PA is the likeliness for a link to appear between 
two nodes with respect to node properties. In or- 
der to measure it, we first have to distinguish be- 
tween (i) single node properties, or monadic prop- 
erties (such as degree, age, etc.) and (ii) node dyad 
properties, or dyadic properties (social distance, 
dissimilarity, etc.). When dealing with monadic 
properties indeed, we seek to know the propension 
of some kinds of nodes to be involved in an inter- 
action. On the contrary when dealing with dyads, 
we seek to know the propension for an interaction 
to occur preferentially with some kinds of couples. 1 

2.1 Monadic PA 

Suppose we want to measure the influence on PA 
of a given monadic property m taking values in 
M = {mi, m„}. 2 We assume this influence can 

1 Note that a couple of monadic properties can be con- 
sidered dyadic; for instance, a couple of nodes of degrees 
fei and &2 considered as a dyad (fcijfe)' This makes the 
former case a refinement, not always possible, of the latter 
case. 

2 This topic will be described more extensively in a forth- 
coming general paper presenting basic parameters for dy- 
namic network analysis 1171 . 
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be described by a function / of m, independent of 
the distribution of agents of kind m. Denoting by 
"L" the event "attachment of a new link", f(m) 
is simply the conditional probability P(L\m) that 
an agent of kind m is involved into an interaction. 

Thus, it is f(m) times more probable that an 
agent of kind m receives a link. We call / the 
interaction propension with respect to m. For 
instance, the classical degree-based PA used in 
Barabasi-Albert and subsequent models — links 
attach proportionally to node degrees [2 El Ej _ 
is an assumption on / equivalent to f(k) oc k. 

P(m) typically denotes the distribution of nodes 
of type m. The probability P(m\L) for a new 
link extremity to be attached to an agent of 
kind m is therefore proportional to /(m)P(m), or 
P(L\m)P(m). Applying the Bayes formula yields 
indeed: 3 

f(m)P(m) 



P(m\L) 



P(L) 



(1) 



with P(L) 



/(m')P(m'). 



E 

m'EM 

Empirically, during a given period of time v 
new interactions occur and 2v new link extrem- 
ities appear. Note that a repeated interaction 
between two already-linked nodes is not consid- 
ered a new link, for it incurs acquaintance bias. 
The expectancy of new link extremities attached 
to nodes of property m along a period is thus 

1v 

v{m) = P(m\L) ■ 2v. As is a constant of 

m and the network is considered static during the 
time period, we may estimate / through / such 
that: 



f(m) = 



v{m) 



P{m) 
/(to) = 



if P{m) > 
if P(m) = 



(2) 



Thus lp(m)f(m) oc f(m), where lp(m) = 1 
when P{m) > 0, otherwise. 

2.2 Dyadic PA 

Adopting a dyadic viewpoint is required whenever 
a property has no meaning for a single node, which 
is mostly the case for properties such as proximity, 
similarity — or distances in general. We there- 
fore intend to measure interaction propension for 
a dyad of agents which fulfills a given property d 

3 For consistency purposes, we also assume / strictly pos- 
itive: Vm £ M, /(m) > 0. 



taking values in T> = {d\, c?2, d n }. Similarly, we 
assume the existence of an essential dyadic inter- 
action behavior embedded into g, a strictly posi- 
tive function of d] correspondingly the conditional 
probability P(L\d). Again, interaction of a dyad 
satisfying property d is g{d) times more probable. 
In this respect, the probability for a link to appear 
between two such agents is: 



P(d\L) 



g(d)P(d) 

P(L) 



(3) 



with P(L) = 9(d')P(d'). 



Here, the expectancy of new links between dyads 



of kind d is v{d) = P(d\L)v. Since 



constant of d we may estimate g with g: 



P(L) 



is a 



)(d) = if P(d) = 

Likewise, we have lp(d)g(d) oc g(d). 



3 Interpreting 
propensions 



interaction 



3.1 Shaping hypotheses 

The PA behavior embedded in / (or g) for a given 
monadic (or dyadic) property can be reintroduced 
as such in modeling assumptions, either (i) by 
reusing the exact empirically calculated function, 
or (ii) by stylizing the trend of / (or g) and ap- 
proximating / (or g) by more regular functions, 
thus making possible analytic solutions. 

Still, an acute precision when carrying this step 
is often critical, for a slight modification in the 
hypotheses (e.g. non-linearity instead of linearity) 
makes some models unsolvable or strongly shakes 
up their conclusions. For this reason, when consid- 
ering a property for which there is an underlying 
natural order, it may also be useful to examine 



the cumulative propension F(rrii) 



/V) 



as an estimation of the integral of /, especially 
when the data are noisy (the same goes with G 
and g). 
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3.2 Correlations between properties 

Besides, if modellers want to consider PA with re- 
spect to a collection of properties, they have to 
make sure that the properties are uncorrelated or 
that they take into account the correlation be- 
tween properties: evidence suggests indeed that 
for instance node degrees depend on age. Of- 
ten models assume properties to be uncorrelated 
which, when it is not the case, would amount to 
count twice a similar effect. 4 

If two distinct properties p and p' are indepen- 
dent, the distribution of nodes of kind p in the sub- 
set of nodes of kind p' does not depend on p', i.e. 
P(plp') 

the quantity must theoretically be equal 

to 1, Vp, Vp'. Empirically, it is possible to estimate 
it through: 5 

J^)=^r iip{p)>0 (5) 

{ cy(p) = ifP(p) = 

in the same manner as previously. 

3.3 Essential behavior 

As such, calculated propensions do not depend on 
the distribution of nodes of a given type at a given 
time. In other words, if for example physicists 
prefer to interact twice more with physicists than 
with sociologists but there are three times more 
sociologists around, physicists may well be appar- 
ently interacting more with sociologists. Never- 
theless, / remains free of such biases and yields 
the "baseline" preferential interaction behavior of 
physicists. 

However, / could still depend on global network 
properties, e.g. its size, or its average shortest path 
length. Validating the assumption that / is in- 
dependent of any global property of the network 
(notably its topological structure) — i.e., that it 
is an entirely essential property of nodes of kind 
p — would require to compare different values of 
/ for various periods and network configurations. 
Put differently, this entails checking whether the 
shape of / itself is a function of global network 
parameters. 

4 Like for instance in 1161 where effects related to degree 
and common acquaintances are combined in an indepen- 
dent way. 

5 For computing the correlation between a monadic and 
a dyadic property, it is easy to interpret P(p\d) as the dis- 
tribution of p-nodes being part of a dyad d. 
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Figure 1 : Sample socio-semantic network (3 agents 
a, a', a" and 3 concepts c, c', c"). 



3.4 Activity 

Additionally, / represents equivalently an attrac- 
tivity or an activity: if interactions occur pref- 
erentially with some kinds of agents, it could as 
well mean that these agents are more attractive 
or that they are more active. If more attractive, 
the agent will be interacting more, thus being ap- 
parently more active. To distinguish between the 
two effects, it is sometimes possible to measure in- 
dependently agent activity, notably when interac- 
tions occur during events, or when interaction ini- 
tiatives are traceable (e.g. in a directed network). 

In such cases, the distinction is far from neu- 
tral for modeling. Indeed, when considering evo- 
lution mechanisms focused not on agents creating 
links, but instead on events gathering agents (like 
in H2]), modellers have to be careful when inte- 
grating back into models the observed PA as a 
behavioral hypothesis. Some categories of agents 
might in fact be more active and accordingly in- 
volved in more events, instead of enjoying more 
attractivity. 

4 An application to socio- 
semantic networks 

4.1 Definitions 

We now apply the above tools to a socio-semantic 
network, that is, a social network where agents 
are also linked to semantic items. We examine 
therein two particular kinds of PA: (i) PA related 
to a monadic property: the node degree; and (ii) 
PA linked to a dyadic property: homophily, i.e. 
the propension of individuals to interact more with 
similar agents. 
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Networks. The social network A is the net- 
work of agents, where links correspond to inter- 
actions: A = (A, Ea), with A denoting the agent 
set and E\ the (undirected) set of links between 
agents. Interactions occur through events, and 
each event is associated with a semantic content, 
made of semantic markers (e.g. keywords), or con- 
cepts. Dually, the concepts form a semantic net- 
work, where concepts are linked to each other if 
they jointly appear in an event. Identically to 
A, we have C — (C,Ec)- Finally, agents are 
linked to concepts associated with events they are 
involved in. We hence deal with a third net- 
work, S = (A, C,i?Ac), and three kinds of links: 
(i) between pairs of agents, (ii) between pairs of 
concepts, and (iii) between concepts and agents. 
Since we measure agent behavior through network 
dynamics, we also consider the temporal series of 
networks A(t), C(t) and S(t), with t G N, which al- 
together make a dynamic socio-semantic network 
(see Fig. [U). 

Empirical protocol. Empirical data come from 
the bibliographical database Medline which con- 
tains dated abstracts of published articles of bi- 
ology and/or medicine. We focused on a portion 
concerning a well-defined community of embryol- 
ogists working on the zebrafish, during the period 
1997-2004. Translated in the above framework, 
articles are events, their authors are the agents, 
and semantic markers are made of expert-selected 
abstract words. 

In order to have a non-empty and statistically 
significant network for computing propensions, we 
first build the network on an initialization period 
of 7 years (from 1997 to end-2003), then carry the 
calculation on new links appearing during the last 
year. The dataset contains around 10, 000 authors, 
5,000 articles and 70 concepts. 

4.2 Linear degree-related PA 

We use Eq. [5] and consider the node degree k as 
property m (thus M = N): in this manner, we in- 
tend to compute the real slope f(k) of the degree- 
related PA and compare it with the assumption 
"/(fc) oc fc". This hypothesis classically relates to 
the preferential linking of new nodes to old nodes. 
To ease the comparison, we considered the subset 
of interactions between a new and an old node. 
Empirical results are shown on Fig. Seem- 
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Figure 2: Degree-related interaction propension 
/, computed on a one-year period, for k < 25. 
The solid line represents the best linear fit. 
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Figure 3: Cumulated propension F. Dots repre- 
sent empirical values, solid color lines are the best 
non-linear fit for F ~ k 2m . 

ingly, the best linear fit corroborates the data and 
tends to confirm that f(k) oc k. The best non- 
linear fit however deviates from this hypothesis, 
suggesting that f(k) oc fc 109 . As suggested above, 
knowing precisely the exponent may be critical 
here. Since there is a natural order on k, we plot- 
ted the cumulated propension F(k) = 5ZjL =1 f(k) 
on Fig. [3J In this case, the best non-linear fit for 
F is F(k) oc fc 2 - 07 , confirming the slight deviation 
from a strictly linear preference which would yield 
fc 2 . 

Rich-work-harder. This precise result is not 
new and agrees with existing studies of the degree- 
related PA (e.g. [151 119| ). Nevertheless, we wish 
to stress a more fundamental point in comput- 
ing this kind of PA. Indeed, considerations on 
agent activity lead us to question the usual un- 
derpinnings and justifications of PA related to 
a monadic property. Concerning degree-related 
PA, it is the "rich-get-richer" metaphor describing 
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Figure 4: Top: Activity a(k) during the same 
period, in terms of articles per period (events per 
period) with respect to agent degree. Best non- 
linear fit is fc 102 . Below: Cumulated activity 

^(*) = Ek=i°(*)- 



rich, or well-connected agents as more attractive 
than poorly connected agents, thus receiving more 
connections and becoming even more connected. 6 

When considering the activity of agents with re- 
spect to fc, that is, the number of events in which 
they participate (here, the number of articles they 
co-author), "rich" agents are proportionally more 
active than "poor" agents (see Fig. and thus 
obviously encounter more interactions. It might 
thus well simply be that richer agents work harder, 
not are more attractive; the underlying behav- 
ior linked to preferential interaction being simply 
"proportional activity". 7 

While formally equivalent from the viewpoint 
of PA measurement, the "rich- get-richer" and 
"rich-work-harder" metaphors are not behav- 
iorally equivalent. One could choose to be blind to 



6 "(■■■) the probability that a new actor will be cast with 
an established one is much higher than that the new actor 
will be cast with other less-known actors" 

7 Indeed, when considering fc as a proxy for agent activ- 
ity (i.e., a behavioral feature), if the number of coauthors 
does not depend on fc (which is actually roughly the case in 
this data) then observing a linear degree-related PA is not 
surprising. 



this phenomenon and keep an interaction propen- 
sion proportional to node degree. On the other 
hand, one could also prefer to consider higher- 
degree nodes as more active, assuming instead 
that the number of links per event is degree- 
independent and that agents do neither prefer, nor 
decide to interact with famous, highly connected 
nodes; a hypothesis suggested by the present em- 
pirical results. If both of these conceptions are 
consistent with the observed quasi-proportional 
PA, they bear different implications for modeling, 
as underlined in Sec. 13.41 

More generally, such feature supports the idea 
that events, not links, are the right level of model- 
ing for social networks — with events reducing in 
some cases to a dyadic interaction. 

4.3 Homophilic PA 

Homophily translates the fact that agents prefer 
to interact with other resembling agents. Here, we 
assess the extent to which agents are "homophilic" 
by introducing an inter-agent semantic distance. 
By semantic distance we mean a function of a 
dyad of nodes that enjoys the following properties: 
(i) decreasing with the number of shared concepts 
between the two nodes, (ii) increasing with the 
number of distinct concepts, (iii) equal to 1 when 
agents have no concept in common, and to when 
they are linked to identical concepts. 

Given (a, a') £ A 2 and denoting by a A the set 
of concepts a is linked to, we introduce a seman- 
tic distance S(a, a') 6 [0; 1] satisfying the previous 
properties: 8 



5(a, a') = 



l(a A \q /A )U(q ,A \a A )| 
|a A Ua' A | 



As S takes real values in [0, 1] we need to dis- 
cretize 8. To this end, we use a uniform partition 
of [0; 1[ in I intervals, to which we add the single- 
ton {!}. We thus define a new discrete property d 



8 Written in 
a A = {ci, 



a more explicit manner, with 
.,c n ,c n+ i, ...,c n+p } and a' A = 
}, we have 8(a,a') = p+q ■ 



{C 1: ...,C n ,c' n + 1 , ...,^ n+gl , „„,„ „,„,„,, — p+q+n 

n and p, q representing respectively the number of ele- 
ments a A and a' A have in common and have in proper. 
We also verify that if n = (disjoint sets), <5(a, a') = 1; if 
n 7^ 0, p = q = (same sets), <5(a, a) = 0; and if a A C a' A 
(included sets), 8(a,a') = — |L , 

This distance is very classical and is based on the Jaccard 
coefficient ||]. It is moreover easy though cumbersome to 
show that <5(., .) is also a metric distance. 
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Figure 5: Homophilic interaction propension g 
with respect to d G V = {d( h ...,^15}. The y-axis 
is in log-scale. 

taking values in V — {do, d\, rfj} consisting of 
1+1 intervals: V = {[0;i[; [± ; f[; ...[*=!; 1[; {1}}. 
Finally, we obtain an empirical estimation of ho- 
mophily with respect to this distance by applying 
Eq.|3|on d, with I = 15. 

The results are gathered on Fig. [5] and show 
that while agents favor interactions with slightly 
different agents (as the initial increase suggests), 
they still very strongly prefer similar agents, as 
the clearly decreasing trend indicates (sharp de- 
crease from di to c?i3, with di being one order 
of magnitude larger than d\z — note also that 
g(do) — g(di) — because no new link appears 
for these distance values) . Agents thus display se- 
mantic homophily, a fact that fiercely advocates 
the necessity of taking semantic content into ac- 
count when modeling such social networks. 

4.4 Correlation between degree and 
semantic distance 

In other words, the exponential trend of g sug- 
gests that scientists seem to choose collaborators 
most importantly because they are sharing inter- 
ests, and less because they are attracted to well- 
connected colleagues, which besides actually seems 
to reflect agent activity. 

As underlined in Sec. 13. II when building a model 
of such network based on degree-related and ho- 
mophilic PA, one has to check whether the two 
properties arc independent, i.e. whether or not 
a node of low degree is more or less likely to be 
at a large semantic distance of other nodes. It 
appears here that there is no correlation between 
degree and semantic distance: for a given semantic 
distance d, the probability of finding a couple of 
nodes including a node of degree k is the same as 



P (k I d) / P (k) 
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Figure 6: Degree and semantic distance corre- 

P(k\d) 

lation estimated through cAk) = — 77^, plot- 

P(k) 

ted here for three different values of d: d S 
{d 5 ,d$,dn}. 

it is for any value of d — see Fig. El To go further, 
we suggest that socio-semantic networks might be 
structured in communities because agents group 
according to similar interests, in epistemic commu- 
nities |25| . through a mechanism involving events 
where agents are more or less active, and gather 
preferentially with respect to their interests; the 
former being entirely independent of the latter. 

Conclusion 

Preferential attachment is the cornerstone of 
growth mechanisms in most recent social network 
formation models. This notion was established 
by the success of a pioneer model J3| rebuilding 
a major stylized fact of empirical networks, the 
scale-free degree distribution. While PA has sub- 
sequently been widely used, few authors have tried 
to check or quantify the rather arbitrary assump- 
tions on PA — when such prospects exist, they are 
mostly dealing with degree-related PA or estimat- 
ing PA phenomena as single parameters. Models 
should go further towards empirical investigation 
when designing hypotheses. This would be really 
appealing to social scientists, who are usually not 
seeking normative models. We are confident the 
present reluctance to measuring interaction behav- 
iors and processes is due to the lack of a clean gen- 
eral framework for this purpose, which is the aim 
of this paper. 

We thus introduced the notion of "interaction 
propension" , whereby we assume that agents have 
an essential preferential interaction behavior. Us- 
ing this concept, we designed measurement tools 
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for quantifying, in a dynamic network, any kind of 
PA with respect to any property of a single node 
or of a dyad of nodes — a generalized preferential 
attachment. The result is a function yielding a 
comprehensive description of interaction behavior 
related to a given property. In addition to clarify- 
ing PA three new features are crucial: (i) proper- 
ties not related to the network structure (such as 
homophily), (ii) correlations between properties, 
(iii) activity of agents and nature of interactions 
(e.g. modeling events, not nodes attaching to each 
other). This kind of hindsight on the notion and 
status of PA should be useful, even for normative 
models. 

We finally applied these tools to a particular case 
of socio-semantic network, a scientific collabora- 
tion network with agents linked to semantic items. 
While we restricted ourselves to a reduced example 
of two significant properties (node degree and se- 
mantic distance), measuring PA relatively to other 
parameters could actually have been very relevant 
as well — such as PA based on social distance for 
instance (shortest path length between two agents 
in the social network). Specifying the list of prop- 
erties is nevertheless a process driven by the real- 
world situation and by the stylized facts the mod- 
eller aims at rebuilding and considers relevant for 
morphogenesis . 

More generally, this framework could be applied 
to any kind of network, as well as adapted to dis- 
connection propensions. Likewise, once propen- 
sions of interaction in the broad sense are known, a 
whole class of social network morphogenesis mod- 
els EOI^] can be designed, with agents interact- 
ing on a growing network according to stylized in- 
teraction heuristics, heuristics precisely based on 
those measured empirically. In fine, introducing 
more credible hypotheses based on real-case em- 
pirical measures would obviously help attract more 
social scientists in this promising field. 
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